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DETAILED ACTION 
Response to Amendment 

1 . The amendment(s), filed on 01/13/2009, have been entered and made of record. Claims 
1-5, 7-13, 15-23, and 25-30 are pending. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-5, 7-13, 15-20, 22, and 27-30 have been 
considered but are moot in view of the new ground(s) of rejection. 

3 . Applicant's arguments filed 0 1/1 3/2009 have been fiiUy considered but they are not 
persuasive. 

For claim 21, Applicant asserts that Kogan does not teach "acquiring position 
information of the camera when a photograph is taken and then querying a geographic database 
to determine a municipality based on the position information of the camera." Examiner 
respectfully disagrees. In [0024] on page 2, Kogan teaches that the information stored (GPS and 
compass data) in the digital camera is used to determine... the field of view of each photograph. 
Also please read pages 1-2, [0015]-[0019]. Additionally, Kogan previously states that the 
location (position) of the camera within the global coordinate system is used to calculate the field 
of view of the image ([0016]). Based on the teachings of Kogan, the Examiner maintains the 
rejection to claims 21 and 23. 

For claim 25, Applicant asserts that Kogan does not teach data that indicates whether a 
landmark is observable from specific geographic coordinates. . .-- "e.g. a latitude and a longitude" 
(see Remarks, page 10 of 16). The Examiner respectfiiUy disagrees. In response to apphcant's 
argument that the references fail to show certain features of applicant's invention, it is noted that 
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the features upon which applicant relies (i.e., a latitude and a longitude) are not recited in the 
rejected claim(s). Although the claims are interpreted in light of the specification, limitations 
from the specification are not read into the claims. See In re Van Geuns, 988 F.2d 1 181, 26 
USPQ2d 1057 (Fed. Cir. 1993). Accordingly, the Examiner maintains the rejection to claims 25 
and 26. 



Claim Rejections - 35 USC § 102 

4. The text of those sections of Title 35, U.S. Code not included in this action can be found 

in a prior Office action. 

5. Claims 21, 23, 25, and 26 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Kogan (US 20040021780). 

For claim 21, Kogan teaches a method for associating meaningful location information 

with photographs (figs. 2-6; pg. 2, [0018]-[0028]) comprising: 

taking a photograph via a camera (fig. 3, ref 305; pg. 2, [0021]); 

acquiring, by the camera, position information of the camera when the photograph is 
taken (fig. 3, ref 320; pg. 2, [0022]); 

associating, at the camera, the position information of the camera with a data 
representation of the photograph (fig. 3; pg. 2, [0020]-[0022]); 

sending the position information of the camera and the data representation of the 
photograph to a computing platform separate from the camera (fig. 4; pg. 2, [0023]); 
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querying, using, via the computing platform, a geographic database (GNIS) to determine 
a municipahty based on the position information of the camera, the geographic database remote 
from the camera and the computing platform (fig. 5; pg. 2, [0023]-[0025]); 

receiving, at the computing platform, municipality content as a fimction of the query (fig. 
5; pg. 2, [0023]-[0025]); 

associating, the computing platform, text indicating a name of the municipality with the 
picture and displaying the text indicating name of the municipality together with the image (figs. 
5-6; pg. 2, [0023]-[0028]). 

For claim 23, Kogan teaches the method of claim 21 wherein the geographic database is 
located on a remotely located server (pg. 2, [0023]-[0024]). 

For claim 25, Kogan teaches a computer-readable recording medium encoded with a 
computer program that performs a method, the method comprising: 

obtaining data from a camera removably connected to a computer platform that indicates 
geographic coordinates associated with each of a plurality of pictures taken by the camera (pg. 2, 
[0020]-[0022]); 

requesting from a remotely located map service server a municipality name 
corresponding to the geographic coordinates associated with each of the plurality of pictures (pg. 
2, [0023]-[0024]); the remotely located map service server including data that indicates whether 
a landmark is observable from specific geographic coordinates; (pg. 2, [0019], [0023]-[0025]) 
and 
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if the geographic coordinates associated with at least one of the plurality of pictures are 
determined to be coordinates in which the landmark is observable, receiving data indicating a 
name of the landmark (pg. 2, [0023]-[0025]). 

For claim 26, Kogan teaches the method of Claim 25 wherein the camera is removably 
connected to the computer platform with a USB cable (pgs. 1-2, [0014], [0023]-[0024]). 

Claim Rejections - 35 USC § 103 

6. The text of those sections of Title 35, U.S. Code not included in this action can be found 

in a prior Office action. 

7. Claims 1-7 are rejected under 35 U.S.C. 103(a) as being unpatentable over Imagawa et 
al. (US Pat. #6,657,666) in view of Pelletier (US Pat. #6,690,883) and Kogan (US 
20040021780). 

As for claim 1, Imagawa discloses a camera (fig. 1, col. 4, lines 33-48; col. 9, lines 1-6) 
comprising: 

an image acquiring means (ref. 1; col. 4, lines 41-48); 

equipment (ref. 2/GPS calculating system not shown in figs.) that determines a physical 
position (col. 4, lines 49-56); 

a database (refs. 5-7) indicating locations of municipalities (col. 5, lines 9-40); and 
an application (refs. 6-9) that uses the database, determines in which municipality the 
physical position is located, associates data indicating a name of the municipality with an image 
acquired by the image acquiring means and displays the name of the municipality together with 
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the image (col. 5, lines 1-43; col. 6, lines 11-22; col. 7, lines 48-54; col. 8, lines 42-62; col. 9, 
lines 7-11). Also see figs. 3-4. 

However, Imagawa does not expressly teach an application (refs. 6-9) that associates data 
indicating a name of the municipality and a name of an associated state with an image acquired 
by the image acquiring means and displays the name of the municipality and the name of the 
associated state together with the image without other informational text, wherein text 
representing the name of the municipality and the name of the associated state is displayed in the 
image free of a separate border surrounding the text. 

In a similar field of endeavor, Pelletier discloses a camera comprising: an application 
(1 15/125/155) that associates data indicating a name of the municipality and a name of an 
associated state with an image acquired by the image acquiring means and displays the name of 
the municipality and the name of the associated state together with the image without other 
infonnational text, wherein text representing the name of the municipality and the name of the 
associated state is displayed (col. 3, lines 1-55; col. 4, lines 49-56). In hght of the teaching of 
Pelletier, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the application of Imagawa as recited in claim 1 in order provide additional 
feature of editing the information transferred to the image (Pelletier, col. 3, line 49 - col. 4, line 
2). 

In a similar field of endeavor, Kogan discloses wherein text representing the name of the 
municipality is displayed in the image free of a separate border surrounding the text (fig. 6, ref 
610; pg. 2, [0026]-[0028]). As illusfrated in fig. 6, ref 610, a separate border the does not 
surround the annotation, which appears next to the image in the photograph. In light of the 
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teaching of Kogan, it would have been obvious to one of ordinary slcill in the art at the time the 
invention was made to modify the camera of Imawaga wherein text representing the name of the 
municipality is displayed in the image free of a separate border surrounding the text in order to 
provide a mechanism for annotating digital images with the names of physical/cultural features 
recorded within the camera's field of view (FOV) thereby making it easier to determine what the 
image contains (Kogan, pg. 1, [0005]). 

For claim 2, Imagawa, as modified by Pelletier and Kogan, discloses the camera of claim 
1 wherein the image acquiring means, the equipment that determines a physical position, the 
database, and the application are all physically located in a single housing (fig. 1, col. 4, lines 33- 
56; col. 9, lines 1-6). 

For claim 3, Imagawa, as modified by Pelletier and Kogan, discloses the camera of claim 
1 wherein the equipment that determines a physical position is a GPS unit (col. 4, lines 49-56). 

For claim 4, Imagawa, as modified by Pelletier and Kogan, discloses the camera of claim 
1 wherein the database associates coordinates with municipalities (col. 5, lines 1-43). 

For claim 5, Imagawa, as modified by Pelletier and Kogan, discloses the camera of claim 
1 wherein municipalities includes cities, towns, and villages (col. 6, lines 1 1-22; col. 7, lines 48- 
54; col. 8, lines 42-62; col. 9, lines 7-1 1). Also see figs. 3-4. 

For claim 6, Imagawa, as modified by Pelletier and Kogan, discloses the camera of claim 
1 wherein the application associates data indicating a state with the image acquired by the image 
acquiring means (col. 4, lines 49-56; col. 5, lines 1-43; col. 6, lines 1 1-22; col. 7, lines 48-54; 
col. 8, lines 42-62; col. 9, lines 7-11). 
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For claim 7, Imagawa, as modified by Pelletier and Kogan, discloses the camera of claim 
1 wherein the database also indicates states (col. 5, lines 1-43; col. 6, lines 1 1-22; col. 7, lines 48- 
54; col. 8, lines 42-62; col. 9, lines 7-1 1). 

8. Claims 8-13 and 15-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Imagawa et al. (US Pat. #6,657,666) in view of Pelletier (US Pat. #6,690,883). 

As for claim 8, Imagawa teaches a method of operation for photography (col. 4, lines 33- 
48; col. 9, lines 1-6) comprising: 

acquiring an image with a camera (col. 4, lines 41-48); 

with position determining equipment associated with the camera (col. 4, lines 49-56), 
acquiring information indicating a position associated with the camera (col. 5, lines 9-40); 

determining a municipality in which the position is located (col. 5, lines 1-43; col. 6, lines 

11-22); 

associating data indicating a name of the municipality (col. 5, lines 1-43; col. 6, lines 11- 
22; col. 7, lines 48-54; col. 8, lines 42-62; col. 9, lines 7-1 1); and 

displays the name of the municipality together with the image (col. 5, lines 1-43; col. 6, 
lines 11-22; col. 7, lines 48-54; col. 8, lines 42-62; col. 9, lines 7-1 1). 

However, Imagawa does not expressly teach associating data indicating a name of the 
municipality and a name of a corresponding country with the image; and displays the name of 
the municipality and the name of the corresponding country without other descriptive text 
together with the image and printing the image with text indicating the municipality and the 
name of the corresponding country. 
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In a similar field of endeavor, Pelletier teaches printing the image with text indicating the 
municipality in the image (col. 2, lines 31-49). In light of the teaching of Pelletier, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made to modify the 
method of Imagawa to print the image with text indicating the municipality in the image in order 
to provide an improved method for annotating captured images with location information 
(Pelletier, col. 1, lines 39-63). Additionally, Pelletier teaches the features of selecting and 
editing the information being transferred to the image (col. 3, line 56 - col. 4, line 2). The 
Examiner takes Official Notice that it is well known in the art to have a method comprising 
associating data indicating a name of the municipality and a name of a corresponding country 
with the image; and displays the name of the municipality and the name of the corresponding 
country without other descriptive ?ex?_together with the image and printing the image with text 
indicating the municipality and the name of the corresponding country. It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to modify the 
method of Imagawa, as modified by Pelletier, with the method as recited in claim 8 in order 
allow the user to optimize the self annotating techniques as taught in Pelletier (col. 3, line 18 - 
col. 4, line 56). 

For claim 9, Imagawa, as modified by Pelletier, teaches the method of claim 8 wherein 
the position determining equipment comprises a GPS unit (col. 4, lines 49-56). 

For claim 10, Imagawa, as modified by Pelletier, teaches the method of claim 8 wherein 
the position determining equipment is installed in the camera (col. 4, lines 49-56). 

For claim 11, Imagawa, as modified by Pelletier, teaches the method of claim 8 wherein 
the position is expressed as geographic coordinates (col. 4, line 49 - col. 5, line 40). 
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For claim 12, Imagawa, as modified by Pelletier, teaches the method of claim 8 wherein 
the municipality is determined using a geographic database installed in the camera (col. 4, line 
49 - col. 5, line 40). 

For claim 13, Imagawa, as modified by Pelletier, teaches the method of claim 8 fiirther 
comprising: adding text indicating the name of the municipality to the image (col. 7, lines 48-54; 
col. 8, lines 42-62; col. 9, lines 7-11). 

For claim 15, Imagawa, as modified by Pelletier, teaches the method of claim 8 wherein 
the municipality in which the position is located is determined using a remotely located 
geographic database (col. 4, lines 49-56). 

As for claim 16, Imagawa teaches a method of operation for photography comprising: 

using a database located within a camera (image information recording reproducing 
apparatus), associating data indicating a municipality with an image taken by the camera (col. 4, 
lines 38-60; col. 5, lines 1-43; col. 6, lines 11-22; col. 7, lines 48-54; col. 8, lines 42-62; col. 9, 
lines 7-11); and 

displaying the image with text indicating a name of the municipality in the image (col. 6, 
lines 11-22; col. 7, lines 48-54; col. 8, lines 42-62; col. 9, lines 7-11). 

However, Imagawa does not expressly teach providing an option to move the text 
indicating the name of the municipality to any part of the image; adding the text indicating the 
name of the municipality to be part of the image; and storing the image having the text indicating 
the name of the municipality. 

In a similar field of endeavor, Pelletier teaches a method of operation for photography 
comprising: providing an option to move the text indicating the name of the municipality to any 
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part of the image; adding the text indicating the name of the municipality to be part of the image; 
and storing the image having the text indicating the name of the municipality (col. 3, lines 1-55; 
col. 4, lines 49-56; col. 5, lines 51-59). In light of the teaching of Pelletier, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to modify the 
application of Imagawa as recited in claim 1 in order provide an improved method for annotating 
captured images with location information (Pelletier, col. 1, lines 39-63) as well as the additional 
feature of editing the information transferred to the image (Pelletier, col. 3, line 49 - col. 4, line 
2). 

For claim 17, Imagawa, as modified by Pelletier, teaches the method of claim 16 fiirther 
comprising: 

using a position determining unit associated with the camera to determine a position of 
the camera when the image is taken (col. 4, line 49 - col. 5, line 6); and 

with the database, using the position to determine the municipality (col. 4, line 49 - col. 
5, line 40). 

For claim 18, Imagawa, as modified by Pelletier, teaches the method of claim 17 wherein 
the position determining unit includes a GPS unit (Imagawa, col. 4, lines 49-56; Pelletier, col. 4, 
lines 49-56). 

For claim 19, Imagawa, as modified by Pelletier, teaches the method of claim 17 wherein 
the position is expressed as geographic coordinates (Imagawa, col. 4, line 49 - col. 5, line 6; 
Pelletier col. 4, lines 49-56). 
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For claim 20, Imagawa teaches the method of claim 16 further comprising: printing the 
image with text indicating the name of the municipality in the image (Imagawa col. 7, lines 48- 
54; col. 8, lines 42-62; col. 9, lines 7-1 1) (Pelletier col. 2, lines 31-49). 

9. Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over Imagawa et al. 
(U.S. Pat. #6,657,666) in view of Pelletier (US Pat. #6,690,883) as applied to claim 8 above, and 
further in view of Baron (U.S. Pat. #6,459,388). 

For claim 22, Imagawa teaches the method of claim 8 (col. 5, lines 1-43; col. 6, lines 11- 
22; col. 7, lines 48-54; col. 8, lines 42-62; col. 9, lines 7-1 1). However, Imagawa does not 
expressly teach that the camera comprises a phone equipped with a camera as a feature. 

In a similar field of endeavor. Baron teaches take a photograph with a phone equipped 
with a camera as a feature (col. 5, lines 1-9; col. 8, lines 28-45). Therefore, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to modify the 
method of Imagawa with a phone equipped with a camera as a feature in order to provide a user 
with information concerning nearby sites (Baron, col. 5, lines 1-9). 

10. Claim 27 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kogan (US 
20040021780) in view of Pelletier (US Pat. #6,690,883). 

For claim 27, Kogan teaches the method of Claim 25 wherein the camera is removably 
connected to the computer platform (pg. 2, [0023]-[0025]). However, Kogan does note 
expressly teach the method wherein the camera is connected to the computer platform with a 
wireless connection with a wireless connection. 
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In a similar field of endeavor, Pelletier teaches a method wherein the camera is connected 
to the computer platform with a wireless connection (col. 3, lines 35-48; col. 4, lines 35-56). . 
In light of the teaching of Pelletier, it would have been obvious to one of ordinary skill in the art 
at the time the invention was made to modify the method of Kogan with the wireless connection 
between the camera and the computer platform as recited in claim 27 in order to provide an 
improved method for annotating captured images with location information (Pelletier, col. 1, 
lines 39-63). 

For claim 28, Kogan discloses a device for associating meaningful location information 

with photographs (fig. 4) comprising: 

a computing platform (400) configured to receive data representing a photograph and 
position information associated with the data from a camera, the computing platform separate 
from the camera (pg. 2, [0023]-[0024]), 

wherein the computing platform is further configured to query a geographic database 
(GNIS) to determine a municipality where the photograph was taken ; and landmark based on the 
position information, the geographic database remote from the computing platform and the 
camera (pg. 2, [0023]-[0025]), 

wherein the computing platform is further configured to receive municipality information 
as a function of the query (pg. 2, [0023]-[0025]), and 

wherein the computing platform is further configured to associate and display the text 
with the photograph (pg. 2, [0023]-[0028] also, please see figs. 5 and 6). 

However, Kogan does not expressly teach wherein the computing platform is further 
configured to provide an option to select between: (i) text indicating a name of the municipality 
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and (ii) text indicating a name of the landmark; and wherein if the text indicating the name of the 
landmark is selected from the option, the computing platform is further configured to associate 
and display the text indicating the name of the landmark with the photograph without displaying 
the text indicating the name of the municipality with the photograph. 

wherein the computing platform is further configured to receive municipality information 
and landmark information as a function of the query, and wherein the computing platform is 
further configured to provide an option to select between: (i) text indicating a name of the 
municipality and (ii) text indicating a name of the landmark; and wherein if the text indicating 
the name of the landmark is selected from the option, the computing platform is further 
configured to associate and display the text indicating the name of the landmark with the 
photograph without displaying the text indicating the name of the municipality with the 
photograph. Additionally, Pelletier teaches the features of selecting and editing the information 
being transferred to the image. In Pelletier, please read col. 3, line 18 - col. 4, line 56. In light of 
the teaching of Pelletier, it would have been obvious to one of ordinary skill in the art at the time 
the invention was made to modify the method of Kogan as recited in claim 28 in order to provide 
an improved method for annotating captured images with location information (Pelletier, col. 1, 
lines 39-63). 

For claim 29, Kogan discloses a server (fig. 4) for associating meaningful location 
information with photographs comprising: 

the server (405) configured to receive a query to determine a municipality in which a 
photograph has been taken, the photograph taken via a remote camera (pg. 2, [0023]-[0024]), 
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wherein the server is further configured to retrieve municipality content and state content 
fi-om a geographic database (GPS) and send the municipality content and the state content to a 
computing platform (400) based on the query, the computing platform remote fi-om the server 
and the camera (pg. 2, [0020]-[0025]), and 

wherein the municipality content and the state content are associated with text indicating 
a name of the municipality and text indicating a name of the state, respectively, the text 
indicating the name of the municipality and the text indicating the name of the state being 
associated with and displayed in the photograph via the computing platform (pg. 2, [0023]- 
[0028]). Also, please see figs. 2-3 and 5-6. 

However, Kogan does not expressly teach the text indicating the name of the 
municipality and the text indicating the name of the state being associated with and displayed in 
the photograph without other informative text. 

In a similar field of endeavor, Pelletier teaches the text indicating the name of the 
municipality and the text indicating the name of the state being associated with and displayed in 
the photograph without other informative text (col. 3, line 18 - col. 4, line 56). In light of the 
teaching of Pelletier, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify the server of Kogan as recited in claim 29 in order to provide an 
improved method for armotating captured images with location information (Pelletier, col. 1, 
lines 39-63). 

For claim 30, Kogan teaches a method for associating meaningful location information 
with photographs comprising: 
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receiving a query to determine a municipality in which a photograph has been taken, the 
photograph taken via a remote camera (pg. 2, [0020]-[0024]); and 

sending municipality content to a remote computing platform based on the query, the 
camera separate from the computing platform, (pg. 2, [0023]-[0028]). Also, please see figs. 2-6. 

However, Kogan does not expressly teach wherein an option to select between text 
indicating a name of the municipality and text indicating a name of a landmark plus the text 
indicating the name of the municipality is provided via the computing platform, wherein if the 
text indicating the name of the municipality is selected from the option, the text indicating the 
name of the municipality and not the text indicating the name of the landmark is displayed in the 
photograph. 

In a similar field of endeavor, Pelletier discloses a method wherein an option to select 
between (i) text indicating a name of the municipality and (ii) text indicating a name of a 
landmark plus the text indicating the name of the municipality is provided via the computing 
platform, wherein if the text indicating the name of the municipality is selected from the option, 
the text indicating the name of the municipality and not the text indicating the name of the 
landmark is displayed in the photograph. Additionally, Pelletier teaches the features of selecting 
and editing the information being transferred to the image. In Pelletier, please read col. 3, line 18 
- col. 4, line 56. In light of the teaching of Pelletier, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify the method of Kogan as 
recited in claim 30 in order to provide an improved method for annotating captured images with 
location information (Pelletier, col. 1, lines 39-63). 
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Conclusion 

1 1 . The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure: 

Grignani (US 2005/0225643) Context enhanced pictures. 

12. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS fi-om the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 . 1 36(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Carramah J. Quiett whose telephone number is (571)272-7316. 
The examiner can normally be reached on 8:00-5:00 M-F. 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's 
supervisor, David Ometz can be reached on (571) 272-7593. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from tlie Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/David L. Ometz/ 

Supervisory Patent Examiner, Art Unit 
2622 

/C. J. Q./ 

Examiner, Art Unit 2622 
April 11,2009 



